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LLP 

(57) ABSTRACT 

A system and method for controlling a remote device over 
a wireless connection. In one embodiment, a hand-held 
computer system having a Bluetooth-enabled transceiver is 
used to control other Bluetooth-enabled devices. A wireless 
connection between a transceiver and a remote device is 
established. A position where a stylus makes contact with a 
surface of an input device of the hand-held computer system 
is registered. The particular position where the stylus ele- 
ment makes contact with the input device is translated into 
a particular command for controlling the remote device. The 
command is then transmitted to the remote device over the 
wireless connection. 

27 Claims, 12 Drawing Sheets 
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PORTABLE DEVICE CONTROL CONSOLE a device and/or method that can satisfy the above need, that 

WITH WIRELESS CONNECTION is relatively simple to introduce into existing homes and 

businesses, and that is user-friendly. In addition, a need 

exists for a device and/or method that satisfies the above 

TECHNICAL FIELD 5 needs, is portable, and is not limited to line-of-sight appli- 

^ . , , . cations. 

The present invention relates to systems and devices 

connected using wireless links, such as systems and devices DISCLOSURE OF THE INVENTION 

that use the Bluetooth technology. In particular, the present ™ . ., . , , 

m , u , j , „ p f „. The present invention provides a system and method that 

invention pertains to a method and system for controlling _ , i , • ,, ljr , . 

. . . . . ° io can be used to remotely control a variety of different devices, 

remote devices over a wireless connection. . , ,. , . ' _ . J . . ' 

including new devices. The present invention also provides 

BACKGROUND ART a svstem anc * method that is relatively easy to introduce into 

existing homes and businesses and that is user-friendly. In 

Consider, for example, the number of devices and appli- addition, the present invention provides a system and 

ances in the typical living room or family room of a is method that is portable and that is not limited to line-of-sight 

residential dwelling: lamps, light switches, a thermostat, and applications. 

consumer electronic devices such as televisions, video cas- i n the present embodiment, the present invention pertains 

sette recorders, and stereos, some of these devices them- to a system and method for controlling remote devices over 

selves comprising multiple devices such as compact disk a w i re less connection (e.g., using a radio signal). In one 

players, tape players, etc. Each of these devices requires 20 embodiment, a portable computer system (e.g., a palmtop or 

manual interaction by a user in order to turn them off or on, hand-held computer) having a transceiver is used to control 

to raise or lower levels, and so on. Other rooms of the house, compliant devices. In a preferred embodiment, the trans- 

as well as factories and places of business, also have ceiver and the remote devices are Bluetooth-enabled 

countless devices and appliances that require manual inter- devices. 

action in order to use and control them, 25 In tfae preseQt embodimeQt of lhe present invention, a 

Of course, many of these devices are or can be remotely wireless connection between the portable computer system 

controlled. In the home, for example, remote control devices and one or more remote devices is established. Each of the 

for televisions, stereos and the like are very common. remote devices is manifested on a display device of the 

Devices for controlling lights, etc., are also available portable computer system, and one of the devices is selected 

although generally not as commonly used. 30 using, for example, a stylus element. 

Remote control devices in each of their present forms In one embodiment, the stylus element can also be used 

have a number of associated shortcomings. For example, a to specify commands for controlling the remote device. A 

separate remote control device may be required for each position where the stylus element makes contact with a 

device to be controlled. In some instances the separate 35 surface of the display device of the portable computer 

remotes can be replaced with a universal remote control; system is registered. The particular position where the stylus 

however, universal remotes still have their shortcomings. element makes contact with the display device is translated 

Generally, current universal remotes often do not have the into a particular command for controlling the remote device, 

resources (e.g., memory and computational logic) to allow The command is then transmitted to the remote device over 

them to be used with all devices, or they may not be capable ^ the wireless connection. 

of controlling a new device. In addition, in order to accom- i n one embodiment, a rendering of the remote device or 

modate the variety of devices to be controlled, universal of a mec hanism that can be used to control the remote device 

remotes usually have a multiplicity of buttons and thus can is displayed on the display device. The contact of the stylus 

be difficult to use. element with a position in the rendering is translated into a 

Another shortcoming associated with current remote con- 45 particular command for controlling the remote device. In 

trol devices is their limited range. Commonly, remote con- another embodiment, a menu of commands for controlling 

trol devices use infrared beams to communicate commands the remote device is displayed on the display device. The 

to the device that is to be controlled, and so the remotes can contact of the stylus element with a position in the menu is 

only be used for line-of-sight applications. Devices behind translated into a particular command for controlling the 

an object, around a corner, or in another room cannot be 50 remote device. 

controlled if they are not in the line of sight of an infrared i n yet ano ther embodiment, the movement of the stylus 

remote. element over the surface of an input device is recognized and 

A more modern solution is to wire devices together into translated into a particular command for controlling the 
a network of some sort, so that they can be controlled from remote device. In another embodiment, by moving the stylus 
a central location such as a personal computer. However, this 55 element over the surface of the input device, motion is 
approach also has a number of shortcomings. For example, imparted to the rendering on the display device of the remote 
the connections and cabling needed may be quite cumber- device or the mechanism for controlling the remote device, 
some and complex. In addition, this approach is difficult and xt, e present invention thus provides a system (e.g., a 
expensive to backfit into existing homes and businesses. Bluetooth -enabled device, specifically a portable computer 
Furthermore, such an approach is not necessarily conve- 60 system) that can be used to remotely control compliant 
nient. For instance, the central computer system is not a devices (e.g., other Bluetooth-enabled devices) over a wire- 
practical or convenient replacement for a television remote, less (radio) connection. With a radio connection, the system 
nor is it portable enough to allow it to be easily moved from 0 f the present invention is not limited to line-of-sight 
one room to another whenever it is necessary to do so. applications. Remote devices can be adapted to receive 

Accordingly, a need exists for a device and/or method that 65 commands over the wireless connection, obviating the need 

can be used to remotely control a variety of different devices for hardwire connections and making the system relatively 

and appliances, including new devices. A need also exists for easy to implement in homes and businesses. The processing 
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power and other features of the portable computer system invention may be practiced without these specific details. In 

enable user-friendly interfaces, and also allow a variety of other instances, well-known methods, procedures, 

remote devices to be controlled, including new devices components, and circuits have not been described in detail 

introduced into the home or business. so as not to unnecessarily obscure aspects of the present 

These and other objects and advantages of the present 5 invention, 

invention will become obvious to those of ordinary skill in Some portions of the detailed descriptions which follow 

the art after having read the following detailed description of are presented in terms of procedures, logic blocks, 

the preferred embodiments which are illustrated in the processing, and other symbolic representations of operations 

various drawing figures. on data bits within a computer memory. These descriptions 

]0 and representations are the means used by those skilled in 

BRIEF DESCRIPTION OF THE DRAWINGS the data processing arts to most effectively convey the 

-j - uu • ♦ j ■ substance of their work to others skilled in the art. A 

The accompanying drawings, which are incorporated in , . . , . , . , , 

, r r t i tt r . c *u * * L a- * procedure, logic block, process, etc, is here, and generally, 

and form a part of this specification, illustrate embodiments 1 , & , *L . V * 

r . u . j « .u *«u u a • «■ ♦ conceived to be a self-consistent sequence of steps or 

of the invention and, together with the description, serve to 1C . . , . . • . ™ 

.... • • i r *i. • *• 15 instructions leading to a desired result. The steps are those 

explain the principles of the invention: . . < . . • , r l. ■ i 

r r r requiring physical manipulations ot physical quantities. 

FIG.l illustrates one embodiment of a network of devices UsU ally, though not necessarily, these quantities take the 

coupled using wireless connections in accordance with the form of electrical or ma g net ic signals capable of being 

present invention. stored, transferred, combined, compared, and otherwise 

FIG. 2 is a block diagram of one embodiment of a portable 20 manipulated in a computer system. It has proven convenient 

computer system in accordance with the present invention. a t times, principally for reasons of common usage, to refer 

FIG. 3 is a top-side perspective view of a portable to these signals as bits, bytes, values, elements, symbols, 

computer system in accordance with one embodiment of the characters, terms, numbers, or the like, 

present invention. It should be borne in mind, however, that all of these and 

FIGS. 4A and 4B are block diagrams showing one 25 similar terms are to be associated with the appropriate 

embodiment of a wireless transceiver coupled to, physical quantities and are merely convenient labels applied 

respectively, a portable computer system and an external to these quantities. Unless specifically stated otherwise as 

device in accordance with the present invention. apparent from the following discussions, it is appreciated 

FIG. 5 illustrates the different operating modes of a 30 that throughout the present invention, discussions utilizing 

wireless transceiver in accordance with one embodiment of lerms such & "establishing," "registering," "recognizing," 

the present invention. "broadcasting," "receiving," "manifesting," "transmitting," 

n^ir-ii** c u* "displaying," or the like, refer to the action and processes 

FIG. 6 illustrates the now of messages between a con- , r J & ' *,aat™ ? ■ M 

„ ... , . * . j . . , (e.g., process 1100 FIG. 11) or a computer system or similar 

trolling device and remote devices in accordance with one > ° ' r , . ' . , r . i . , 

... , flL , . intelligent electronic computing device, that manipulates 

embodiment of the present invention. 35 . r . 1 . • 1 ✓ , ^ 

r and transforms data represented as physical (electronic) 

FIG. 7 illustrates one embodiment of a display used on a quantilies within the computer system's registers and memo- 
controlling device in accordance with the present invention. ries int0 other data similarly represented as physical quan- 

FIG. 8 illustrates another embodiment of a display used tities within the computer system memories or registers or 

on a controlling device in accordance with the present other such information storage, transmission or display 

invention. 40 devices. 

FIG. 9 illustrates another embodiment of a display used The present invention is discussed primarily in a context 

on a controlling device in accordance with the present in which devices and systems are coupled using wireless 

invention. links, and specifically with regard to devices and systems 

FIG, 10 illustrates a display on a controlling device 4S compliant with the Bluetooth technology. Bluetooth is the 

responding to movement on an input device in accordance code name for a technology specification for small form 

with one embodiment of the present invention. factor, low-cost, short-range radio links between personal 

FIG. 11 is a flowchart of the steps in a process for ' computers (PCs), mobile phones and other devices and 

controlling a remote device over a wireless connection in appliances. However, it is appreciated that the present inven- 

accordance with one embodiment of the present invention. 50 tion ma y be utili zed with devices and systems compliant 

with standards different from Bluetooth, such as the IEEE 

BEST MODE FOR CARRYING OUT THE (Institute of Electronic and Electrical Engineering) 802,11 

INVENTION standard. 

Reference, will now be made in detail to the preferred The Bluetooth technology allows cables that connect one 

embodiments of the invention, examples of which are Mus- 55 device to another to be replaced with short-range radio links, 

trated in the accompanying drawings. While the invention Bluetooth is targeted at mobile and business users who need 

will be described in conjunction with the preferred to establish a link, or small network, between their computer, 

embodiments, it will be understood that they are not cellular phone and other peripherals. The required and 

intended to limit the invention to these embodiments. On the nominal range of Bluetooth is thus set to approximately ten 

contrary, the invention is intended to cover alternatives, 60 ( 10 ) meters. To support other uses, for example the home 

modifications and equivalents, which may be included environment, Bluetooth can be augmented to extend the 

within the spirit and scope of the invention as defined by the range to up to 100 meters. 

appended claims. Furthermore, in the following detailed The Bluetooth technology is based on a high- 
description of the present invention, numerous specific performance, yet low-cost, integrated radio transceiver. For 
details are set forth in order to provide a thorough under- 65 instance, Bluetooth transceivers built into both a cellular 
standing of the present invention. However, it will be telephone and a laptop computer system would replace the 
obvious to one of ordinary skill in the art that the present cables used today to connect a laptop to a cellular telephone. 
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Bluetooth radio technology can also provide: a universal touch-screen device incorporated with display device 105. 

bridge to existing data networks, a peripheral interface, and On-screen cursor control device 107 is capable of registering 

a mechanism to form small private ad hoc groupings of a position on display device 105 where a stylus makes 

connected devices away from fixed network infrastructures. contact. 

FIG. 1 illustrates the topology of a network of devices 5 In accordance with the present invention, a stylus can be 

coupled using wireless connections in accordance with one used to select a command for controlling a remote device by 

embodiment of the present invention. In the parlance of touching the stylus to display device 105, In one 

Bluetooth, a collection of devices connected in a Bluetooth embodiment, a command can be selected from a menu of 

system are referred to as a "piconet" or a "subnet." In the commands displayed on display device 105. In another 

present embodiment, a piconet starts with two connected 10 embodiment, a rendering of the remote device or of a 

devices, and may grow to eight connected devices. All mechanism for controlling the remote device may be mani- 

Bluetooth devices are peer units; however, when establish- fested on display device 105, and a command can be 

ing a piconet, one unit will act as a master and the other(s) selected by touching the stylus to a prescribed location in the 

as slave(s) for the duration of the piconet connection. rendering. The position where the stylus contacts display 

.A Bluetooth system supports both point-to-point and 15 device 105 » registered and fed to processor 101, which 

point-to-multi-point connections. Several piconets can be translates this information into a command for controlling 

established and linked together in a "scatternct," where each the remote device. The command is then transmitted to the 

piconet is identified by a different frequency hopping remote device over a wireless connection using signal 

sequence. All devices participating on the same piconet are transmitter/receiver device ("transceiver") 108. 

synchronized to their respective hopping sequence. 20 Also included in computer system 100 of FIG. 2 is an 

Accordingly, devices 10, 20, 30 and 40 are coupled in in P m device 106 that in one implementation is a stroke or 

piconet 1 using wireless connections 80a-c. Similarly, character recognition pad (e.g., a "digitizer"). Input device 

devices 50, 60 and 70 are coupled in piconet 2 using wireless 106 can communicate information and command selections 

connections 80^-/. Piconet 1 and piconet 2 are coupled using 10 processor 101. Input device 106 is capable of registering 

wireless connection 804. Devices 10-70 can be printers, a position where a stylus (or an element having the func- 

personal digital assistants (PDAs), desktop computer tionality of a stylus) makes contact. Input device 106 also 

systems, laptop computer systems, cell phones, fax has the capability of registering movements of a stylus (or an 

machines, keyboards, and joysticks equipped with a Blue- element having the functionality of a stylus) across or above 

tooth radio transceiver or adapted to communicate with 3Q tne surface of input device 106. 

Bluetooth devices ("Bluetooth-enabled"). In accordance In accordance with the present invention, in one 

with the present invention, devices 10-70 can also be embodiment, a stylus can be used for making a stroke or 

virtually any type of device, including mechanical devices inscribing a character on the surface of input device 106. The 

and appliances, equipped with a Bluetooth radio transceiver stroke or character information is then fed to a processor 101 

or Bluetooth-enabled. The Bluetooth radio transceiver may 35 for automatic character recognition. Once the stroke or 

be integrated into the device, or it may be coupled to the character information is recognized, it can be displayed on 

device, display device 105 for verification and/or modification. 

FIG. 2 is a block diagram of a portable computer system In accordance with the present invention, stroke informa- 
100 (e.g., a PDA, a hand-held computer system, or palmtop tion entered onto input device 106 can correspond to a 
computer system) upon which embodiments of the present 40 command that can be used to control a remote device. That 
invention can be implemented. Computer system 100 is, particular strokes or characters can correspond to a 
includes an address/data bus 110 for communicating respective command. A stroke or character is recognized by 
information, a central processor 101 coupled with the bus for processor 101 and translated by processor 101 into a corn- 
processing information and instructions, a volatile memory mand for controlling a remote device. The command is then 
102 (e.g., random access memory, RAM) coupled with the 45 transmitted to the remote device over a wireless connection 
bus 110 for storing information and instructions for the using transceiver 108. 

central processor 101 and a non-volatile memory 103 (e.g., With reference still to FIG. 2, transceiver 108 is coupled 

read only memory, ROM) coupled with the bus 110 for to bus 110 and enables computer system 100 to communi- 

storing static information and instructions for the processor cate wirelessly with other electronic devices coupled in a 

101. Computer system 100 also includes an optional data 50 piconet or scatternet (refer to FIG. 1). It should be appre- 

storage device 104 (e.g., memory stick) coupled with the bus ciated that within the present embodiment, transceiver 108 

110 for storing information and instructions. Data storage is coupled to an antenna and provides the functionality to 

device 104 can be removable. transmit and receive information over a wireless communi- 

Computer system 100 also contains a display device 105 cation interface. In one embodiment, transceiver 108 is a 

coupled to the bus 110 for displaying information to the 55 Bluetooth device. Additional information with regard to the 

computer user. The display device 105 utilized with com- Bluetooth embodiment is provided in conjunction with 

puter system 100 may be a liquid crystal display device, a FIGS. 4A and 4B. 

cathode ray tube,(CRT), a field emission display device (also FIG. 3 is a perspective illustration of the top-side face 

called a flat panel CRT) or other display device suitable for 100a of one embodiment of the portable computer system 

generating graphic images and alphanumeric characters rec- 60 100 (FIG. 2) in accordance with the present invention. The 

ognizable to the user. In the preferred embodiment, display top-side face 100a contains one or more dedicated and/or 

device 105 is a fiat panel display. programmable buttons 75 for selecting information and 

Computer system 100 also includes a cursor control or causing the computer system to implement functions. The 

directing device (on-screen cursor control 107) coupled to on/off button 95 is also shown. 

bus 110 for communicating user input information and 65 In the present embodiment, the top-side face 100a con- 
command selections to processor 101. In one tains a display device 105 typically surrounded by a bezel or 
implementation, on-screen cursor control device 107 is a cover. A removable stylus element 90 is also shown. The 



05/05/2004, EAST Version: 1.4.1 



US 6,622,018 Bl 

7 8 

display device 105 is a touch screen capable of registering Card, etc.). In the present embodiment, interface 240 runs 

contact between the screen and the tip of the stylus element software that allows transceiver 108 to interface with por- 

90. The top-side face 100a also contains an input device 106 table computer system 100 or external device 290. 

that in one implementation is a stroke or character recogni- FIG. 5 illustrates the different operating modes of a 

tion pad. Input device 106 is a touch screen type of device 5 wireless transceiver 108 (FIGS. 4A and 4B) in accordance 

capable of registering contact with a tip of stylus element 90, with one embodiment of the present invention. In the 

and also can register movements of the stylus element. The Bluetooth embodiment, before any connections between 

stylus element 90 can be of any shape and material to make Bluetooth devices are created, all devices are in standby 

contact with the display device 105 and input device 106. mo de (502). In this mode, an unconnected unit "listens" for 

FIGS. 4A and 4B are block diagrams of one embodiment 10 messages at a regular rate (e.g., every 1.28 seconds) on a set 

of a transceiver 108 in accordance with the present inven- of hop frequencies defined for that unit. The hold mode 

tion. In a preferred embodiment (the "Bluetooth (514) is a power saving mode that can be used for connected 

embodiment", transceiver 108 is a Bluetooth device com- units if no data need to be transmitted. The sniff mode (516) 

prising a digital component (e.g., a Bluetooth controller) and and park mode (512) are also low power modes. In the sniff 

an analog component (e.g., a Bluetooth radio). In accor- 15 mode, a device listens to the piconet at a reduced rate 

dance with the present invention, a transceiver 108 is (relative to the regular rate), thus reducing its duty cycle, 

coupled via a system bus 110 to a system or device that will The sniff interval is programmable and depends on the 

be used to control remote devices (e.g., portable computer application. In the park mode, a device is still synchronized 

system 100 of FIG. 2). Similarly, a transceiver 108 is to the piconet but does not participate in the traffic, 

coupled via a connector 250 to each remote device that is to 20 A connection between devices is made by a "page" 

be controlled (e.g., external device 290). message (506) if the address is already known, or by an 

With reference to both FIGS. 4A and 4B, in the present "inquiry" message (504) followed by a subsequent page 
embodiment, transceiver 108 comprises an antenna 205 for message if the address is unknown. When connected (510), 
receiving or transmitting radio signals, a radio frequency data can be transmitted (508) between devices. 
(RF) module 210, a link controller 220, a microcontroller (or 25 FIG. 6 illustrates the flow of messages between a con- 
central processing unit) 230, and an external interface 240. trolling device (e.g., portable computer system 100) and 

In the Bluetooth embodiment, RF module 210 is a Blue- remote devices to be controlled (610, 620 and 630) in 

tooth radio. Bluetooth radios operate in the ISM (Industrial, accordance with the present embodiment of the present 

Scientific, Medical) band at 2.4 GHz. A frequency hop 3Q invention. In one embodiment, portable computer system 

transceiver is applied to combat interference and fading. 100 and remote devices 610-630 are Bluetooth devices or 

Bluetooth uses a packet -switching protocol based on a Bluetooth-enabled devices. 

frequency hop scheme with 1600 hops/second. Slots can be In the present embodiment, when it is necessary to locate 

reserved for synchronous packets. A packet nominally cov- and identify compliant devices, portable computer system 

ers a single slot, but can be extended to cover up to five slots. 35 transmits a broadcast message 640 (e.g., an inquiry 504) that 

Each packet is transmitted in a different hop frequency. The is received by compliant remote devices 610-630. For 

entire available frequency spectrum is used with 79 hops of example, a user with portable computer system 100 enters a 

one (1) MHz bandwidth, defined analogous to the IEEE room containing remote devices 610-630, Portable com- 

802,11 standard. The frequency hopping scheme is com- puter system 100, either automatically or in response to a 

bined with fast ARQ (Automatic Repeat Request), cyclic 4Q user input, transmits broadcast message 640 for the purpose 

redundancy check (CRC) and Forward Error Correctioo of discovering compliant devices in the room. 

(FEC) for data. As compliant devices, remote devices 610-630 respond to 

In the present embodiment, link controller 220 is a broadcast message 640 via responses 650a, 650/? and 650c, 

hardware digital signal processor for performing baseband respectively. In the present embodiment, responses 650a-c 

processing as well as other functions such as Quality-of- 45 include the Medium Access Control (MAC) address for 

Service, asynchronous transfers, synchronous transfers, remote devices 610-630. Typically, each remote device is 

audio coding, and encryption. assigned a temporary MAC address for the duration of the 

In one embodiment, microcontroller 230 is an application connection. All communications between portable computer 
specific integrated circuit (ASIC). In the Bluetooth system 100 and a remote device carry the MAC address of 
embodiment, microcontroller 230 is a separate central pro- 50 the remote device. Responses 650a-c can also include 
cessing unit (CPU) core for managing transceiver 108 and information characterizing, for example, the type and capa- 
for handling some inquiries and requests without having to bilities of each remote device. This information may include 
involve the host device. In the Bluetooth embodiment, an identifier that can be used by portable computer system 
microcontroller 230 runs software that discovers and com- 100 to characterize the remote device based on information 
municates with other Bluetooth devices via the Link Man- 55 stored in a database or lookup table, 
ager Protocol (LMP). The LMP provides a number of Portable computer system 100 can then transmit a corn- 
services including sending and receiving of data, inquiring mand 660 to a selected remote device (e.g., remote device B 
of and reporting a name or device identifier, making and 620). Command 660 is a command for controlling the 
responding to link address inquiries, connection setup, remote device in some prescribed manner (e.g., turning the 
authentication, and link mode negotiation and setup. The go device off or on, raising or lowering a level, etc.) based on 
LMP also can be used to place transceiver 108 in "sniff" the type of device and its capabilities. In accordance with the 
mode, "hold" mode, "park" mode or "standby" mode (refer present invention, a second device can be selected (e.g., 
to FIG. 5 below). remote device C 630), and a command 670 can be trans- 

With reference still to FIGS. 4A and 4B, in the present mitted to that device, 

embodiment, interface 240 is for coupling transceiver 108 to 65 In the present embodiment, when a connection between 

portable computer system 100 or to external device 290 in portable computer system 100 and a remote device has 

a suitable format (e.g., USB, PCMCIA, PCI, CardBus, PC already been established, or when the MAC address of the 
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remote device is known, broadcast message 640 is a page 
506 (FIG. 5) instead of an inquiry 504. 

FIG. 7 illustrates one embodiment of a display used on a 
controlling device (e.g., portable computer system 100) in 
accordance with the present invention. As described above, 
portable computer system 100 includes a display device 105, 
an input device 106, and a stylus element 90. 

In this embodiment, with reference also to FIG. 6, each of 
the remote devices 610-630 have sent a response 650a-c, 
respectively, to portable computer system 100 in response to 
broadcast message 640. Accordingly, each of remote devices 
610-630 are indicated on display device 105. For example, 
an icon can be used to represent each remote device, each 
remote device can be identified by its name in a menu, etc. 
It is appreciated that other mechanisms may be used to 
indicate a remote device on display device 105 in accor- 
dance with present invention. 

In the present embodiment, a user can then select one of 
the remote devices by touching stylus element 90 to display 
device 105. It is appreciated that an element other than stylus 
element 90 can be used to make a selection, or that another 
mechanism may be used to make a selection. For example, 
the user may simply touch the screen, or an on-screen cursor 
of some type may be used. 

FIG. 8 illustrates another embodiment of a display used 
on a controlling device (e.g., portable computer system 100) 
in accordance with the present invention. In this 
embodiment, a connection has been established between the 
controlling device and the device to be controlled, and the 
characteristics otfthe device to be controlled have been 
identified. In this embodiment, display device 105 displays 
a rendering of a mechanism that can be used to control the 
remote device, such as an on/off switch. In the present 
embodiment, a user can turn the remote device on by 
touching stylus element 90 to position 802 in the rendering, 
and can turn the remote device off by touching stylus 
element 90 to position 804. However, it is appreciated that 
an element other than stylus element 90 can be used to make 
a selection, or* that another mechanism may be used to make 
a selection. 

In one embodiment, a user can also control the remote 
device using input device 106. As described above, input 
device 106 is adapted to recognize movements of stylus 90 
on or above the surface of input device 106, and to translate 
particular movements into particular commands. Thus, for 
example, a user might turn on the remote device by writing 
the word "on" using input device 106. Alternatively, a user 
might instead write a character that represents the command 
"on" in some type of shortened version, or might make a 
stroke that represents this command. It is appreciated that 
other mechanisms, styles, and methods can be used to input 
a command using input device 106 in accordance with the 
present invention. 

FIG. 9 illustrates another embodiment of a display used 
on a controlling device (e.g., portable computer system 100) 
in accordance with the present invention. In this 
embodiment, a connection has been established between the 
controlling device and the device to be controlled, and the 
characteristics of the device to be controlled have been 
identified. In this embodiment, display device 105 displays 
a menu 910 of commands for the remote device, such as an 
"on" command and an "off" command. In the present 
embodiment, a user can turn the remote device on by 
touching stylus element 90 to a particular position in the 
menu 910. It is appreciated that an element other than stylus 
element 90 can be used to make a selection, or that another 
mechanism may be used to make a selection. 
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FIG. 10 illustrates a display on a controlling device (e.g., 
portable computer system 100) responding to movement on 
an input device 106 in accordance with one embodiment of 
the present invention. In this embodiment, a connection has 

5 been established between the controlling device and the 
device to be controlled, and the characteristics of the device 
to be controlled have been identified. In this embodiment, 
for example, a variable level of the remote device is to be 
controlled (e.g., a level of brightness if the remote device is 

10 a light). 

In the present embodiment, the level to be controlled is 
indicated by an indicator 1020 displayed on display device 
105. A user touches stylus element 90 to input device 106, 
and moves the stylus as indicated by stroke 1010. In 

15 response to the. motion of the stylus across input device 106, 
indicator 1020 moves in a corresponding manner along the 
path 1030. That is, motion is imparted to indicator 1020 by 
moving stylus element 90 on input device 106. It is appre- 
ciated that an element other than stylus element 90, or 

20 another type of mechanism, can be used with input device 
106. 

It is appreciated that, in accordance with the present 
invention, different mechanisms for controlling the remote 
device can be rendered on display device 105, different types 

25 of movement can be used with input device 106, and 
different types of motion can be imparted to the rendering on 
display device 105 in response to the movements on input 
device 106. In accordance with the present embodiment of 
the present invention, either the motion of the stylus itself or 

30 the corresponding motion of the rendering can be translated 
into a command for controlling the remote device. 

FIG. 11 is a flowchart of the steps in a process 1100 for 
controlling a remote device over a wireless connection in 

35 accordance with one embodiment of the present invention. 
In step 1110, a wireless connection is established between 
the controlling device (e.g., portable computer system 100 
of FIG. 6) and a remote device or remote devices to be 
controlled (e.g., remote devices 610, 620 and 630 of FIG, 6). 

4Q As described above, if the MAC addresses of remote devices 
610-630 are known, then a page 506 (FIG. 5) is used by 
portable computer system 100; otherwise, an inquiry 504 
(FIG. 5) is used. In response to the broadcast message, each 
of remote devices 610-630 sends a response to portable 

45 computer system 100. In the Bluetooth embodiment, the 
broadcast message and the responses are transmitted using 
radio signals. 

In one embodiment, the characteristics and capabilities of 
remote devices 610-630 are identified in the response. In 

50 another embodiment, the characteristics and capabilities of 
various types of devices are stored in a database or lookup 
table in a memory unit of portable computer system 100. In 
this latter embodiment, the responses from the remote 
devices include an identifier that can be used by portable 

55 computer system 100 to retrieve the characteristics and 
capabilities of remote devices 610-630 from memory. 

In step 1120 of FIG. 11, each of the remote devices (e.g., 
remote devices 610-630) responding to the broadcast mes- 
sage is manifested on portable computer system 100. In one 

60 embodiment, each remote device is indicated on display 
device 105 of portable computer system 100 (refer to FIG. 
7). The characteristics and capabilities of each remote device 
610-630 are linked to the indications (e.g., icons) on display 
device 105. 

65 In step 1130, one of the remote devices 610-630 is 
selected by a user. In one embodiment, the user makes a 
selection by touching a stylus (e.g., stylus element 90 of 
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FIG. 7) to the screen of display device 105. It is appreciated thus described. While the present invention, has been 
that, if only one remote device is present or if a response is described in particular embodiments, it should be appreci- 
received from only one remote device, then step 1130 may ated that the present invention should not be construed as 
be bypassed. limited by such embodiments, but rather construed accord- 
In step 1140 of FIG. 11, as described above in conjunction 5 mg to the following claims, 
with FIGS. 8, 9 and 10, a user can input a command for What is claimed is: 

controlling any of remote devices 610-630 using display 1. A method for controlling a remote devices over a 
device 105 and/or input device 106. In various wireless connection, said method comprising: 
embodiments, display device 105 displays a rendering of the a) establishing said wireless connection between a trans- 
remote device, a rendering of a mechanism for controlling 1Q ceiver and said remote device by: 
the remote device, or a menu of commands for controlling broadcasting a message, said message for locating 
the remote device. In one embodiment, a user can use stylus remote devices within range of said transceiver; and 
element 90 to make contact with the surface of display receiving a response from said remote device; 
device 105. The position where stylus element 90 contacts 5) manifesting said remote device on a display device; 
the surface of input device 105 is registered and translated ^ c j registering a position where contact is made with a 
into a particular command. surface of an input device, wherein a particular position 
In another embodiment, a user can input a command using on sa j d input device is translated into a particular 
input device 106 and stylus element 90, by inscribing a command for controlling said remote device; and 
command or by using a character or stroke that represents a d ) transmitting a command to said remote device over 
command. In these cases, input device 106 registers the 2Q said wire i ess connection. 

movement of the stylus and translates the movement into a 2 ^ met hod as recited in claim 1 wherein said step c) 

particular command. In another embodiment, a user can comprises the step of: 

impart motion to the rendering of the remote device dis- registering a position where a stylus element makes 

played on display device 105 by moving stylus element 90 witfa said SUfface of said input devlce 

on input device 106. The motion of the stylus or the 25 3 The method ag redted ^ daim 2 wherein said step c) 

corresponding motion of the rendering can be translated into comprises the step of: 

a command for controlling the remote device. . . . c . , . t « . . A 

& recognizing a movement of said stylus element over said 

In step 1150 of FIG. 11, the command (e.g., command 660 surface of ^ input device> wherein a particular move . 

of FIG. 6) is transmitted to the remote devrce. In accordance m£nt of ^ stylus elemem ^ tandated mto a particu- 

with the present invention, additional commands can also be 30 hl mamusli for controlling said Kmote devic6 . 

sent to the remote device. In the Bluetooth embodiment, 4 ^ method M redted in claim 2 &rther ^p^ng the 

commands are transmitted via a radio signal. s[eo Q £. 

In the case in which more than one remote device is to be registering a posmon where said stylus element makes 

controlled, another remote device can be selected as in step comact ^ a scfeen of said display device> wherein a 

1130, and commands can be input and transmitted to that 35 particu i ar position on said * translated into a 

device as described above. Furthermore, portable computer particular command for controlling said remote device, 

system 100 can be transported to a new location (e.g., 5 ^ method M redted in c , aim 1 &Ither amp[ising the 

another room), and process 1100 can be repeated to locate steps of 

and identify compliant remote devices in the new location, . . , c . , . 

. . , , , . j . p \ receiving responses from a plurality of remote devices; 

establish connections with those devices, and speciry and 4 n .„ . * • 

transmit commands for controlling those devices. Hie pro- manifesting each of said plurality of remote devices on 

cessing power and intelligence of portable computer system sai 1S P a ^ evice » an 

100 in combination with the processing power and intelli- selecting one of said plurality of remote devices, 

gence of each transceiver 108 (in both portable computer 6 - ^ method as recited m claim 1 further comprising the 

system 100 and in the remote device; refer to FIGS. 4A and 45 ste P of: 

4B) permit portable computer system 100 to be updated as displaying on said display device a rendering of a mecha- 

needed, so that it can operate as a universal remote control nism for controlling said remote device, 

device for a multiplicity of different devices, including new 7 * method as recited in claim 6 further comprising the 

devices. ste P of: 

Thus, the present invention provides a system and method so contacting a particular position in said rendering, wherein 

that can be used to remotely control a variety of different said contacting is translated into a particular command 

devices. In one embodiment, the present invention provides corresponding to said particular position, 

a system (e.g., a Bluetooth-enabled device, specifically a 8 * The method as recited in claim 6 further comprising the 

portable computer system) that can be used to remotely ste P °f ; 

control compliant devices (e.g., other Bluetooth-enabled 55 imparting motion to said rendering in response to move- 
devices) over a wireless (radio) connection. With a radio ment of a stylus element over said surface of said input 
connection, the system of the present invention is not limited device. 

to line-of -sight applications. Remote devices can be adapted 9. The method as recited in claim 1 further comprising the 

to receive commands over the wireless connection, obviat- steps of: 

ing the need for hardwire connections and making the 60 displaying on said display device a menu of commands 

system relatively easy to implement in homes and busi- . for controlling said remote device; and 

nesses. The processing power and other features of the contacting a particular position in said menu, wherein said 

portable computer system enable user-friendly interfaces, contacting is translated into a particular command 

and also allow a variety of remote devices to be controlled, corresponding to said particular position, 

including new devices introduced into the home or business. 65 10. The method as recited in claim 1 wherein said 

The preferred embodiment of the present invention, por- transceiver and said remote device are Bluetooth-enabled 

table device control console with wireless connection, is devices. 



05/05/2004, EAST Version: 1.4.1 



us 6,6: 

13 

11. A computer system comprising: 
a bus; 

a processor coupled to said bus; 

a transceiver coupled to said bus; 

a display device coupled to said bus; and 

an input device coupled to said bus; 

said processor for performing a method for controlling a 
remote device over a wireless connection, said method 
comprising the computer-implemented steps of; 

a) establishing said wireless connection between said 
transceiver and said remote device by: 
broadcasting a message, said message for locating 

remote devices within range of said transceiver; 
and 

receiving a response from said remote device; 

b) manifesting said remote device on a display device; 

c) registering a position where contact is made with a 
surface of an input device, wherein a particular 
position on said input device is translated into a 
particular command for controlling said remote 
device; and 

d) transmitting a command to said remote device over 
said wireless connection. 

12. The computer system of claim 11 wherein said step c) 
of said method comprises the step of: 

registering a position where a stylus element makes 
contact with said surface of said input device. 

13. The computer system of claim 12 wherein said step c) 
of said method further comprises the step of: 

recognizing a movement of said stylus element over said 
surface of said input device, wherein a particular move- 
ment of said stylus element is translated into a particu- 
lar command for controlling said remote device. 

14. The computer system of claim 12 wherein said 
method further comprises the steps of: 

registering a position where said stylus element makes 
contact with a screen of said display device, wherein a 
particular position on said screen is translated into a 
particular command for controlling said remote device. 

15. The computer system of claim 11 wherein said method 
further comprises the steps of: 

receiving responses from a plurality of remote devices; 
manifesting each of said plurality of remote devices on 

said display device; and 
selecting one of said plurality of remote devices. 

16. The computer system of claim 11 further comprising 
the step of: 

displaying on said display device a rendering of a mecha- 
nism for controlling said remote device. 

17. The computer system of claim 16 wherein said 
method further comprises the step of: 

contacting a particular position in said rendering, wherein 
said contacting is translated into a particular command 
corresponding to said particular position. 

18. The computer system of claim 16 wherein said 
method further comprises the step of: 

imparting motion to said rendering in response to move- 
ment of a stylus element over said surface of said input 
device. 
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19. The computer system of claim 11 wherein said method 
further comprises the steps of: 

displaying on said display device a menu of commands 
for controlling said remote device; and 

contacting a particular position in said menu, wherein said 
contacting is translated into a particular command 
corresponding to said particular position. 

20. The computer system of claim 11 wherein said trans- 
10 ceiver and said remote device are Bluetooth-enabled 

devices. 

21. A hand -held computer system for controlling a remote 
.device over a radio connection, said system comprising: 

a bus; 

15 a processor coupled to said bus; 

a transceiver coupled to said bus, said transceiver for 
transmitting commands for controlling said remote 
device over said radio connection, wherein said trans- 

20 ceiver is adapted to broadcast a message for locating 
remote devices within range of said transceiver, 
wherein each remote device responding to said mes- 
sage is indicated on said display device; 
a display device coupled to said bus, said display device 

25 adapted to register a position where a stylus element 
makes contact with a screen of said display device, 
wherein a particular position on said screen is trans- 
lated into a particular command for controlling said 

3Q remote device; and 

an input device coupled to said bus, said input device 
adapted to register a position where a stylus element 
makes contact with a surface of said input device, 
wherein a particular position on said input device is 

35 translated into a particular command for controlling 
Said remote device, 

22. The computer system of claim 21 wherein said input 
device is adapted to recognize a movement of said stylus 
element over said surface of said input device, wherein a 

40 particular movement of said stylus element is translated into 
a particular command for controlling said remote device. 

23. The computer system of claim 21 wherein said 
transceiver and said remote device are Bluetooth-enabled 
devices. 

45 

24. The computer system of claim 21 wherein said display 
device is adapted to display a rendering of a mechanism for 
controlling said remote device. 

25. The computer system of claim 24 wherein said display 
50 device is adapted to register a position where said stylus 

element makes contact within said rendering, wherein a 
particular position within said rendering is translated into a 
particular command for controlling said remote device. 

26. The computer system of claim 24 wherein said display 
55 device is adapted to impart motion to said rendering in 

response to movement of said stylus element over said 
surface of said input device. 

27. The computer system of claim 21 wherein said display 
device is adapted to display a menu of commands for 

60 controlling said remote device. 

* * * * * 
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